Sparse coding of sensory inputs.
نویسندگان
چکیده
Several theoretical, computational, and experimental studies suggest that neurons encode sensory information using a small number of active neurons at any given point in time. This strategy, referred to as 'sparse coding', could possibly confer several advantages. First, it allows for increased storage capacity in associative memories; second, it makes the structure in natural signals explicit; third, it represents complex data in a way that is easier to read out at subsequent levels of processing; and fourth, it saves energy. Recent physiological recordings from sensory neurons have indicated that sparse coding could be a ubiquitous strategy employed in several different modalities across different organisms.
منابع مشابه
Towards a unified theory of efficient, predictive and sparse coding
A central goal in theoretical neuroscience is to predict the response properties of sensory neurons from first principles. Several theories have been proposed to this end. “Efficient coding” posits that neural circuits maximise information encoded about their inputs. “Sparse coding” posits that individual neurons respond selectively to specific, rarely occurring, features. Finally, “predictive ...
متن کاملRobust Speaker Verification Based on Max Pooling of Sparse Representation
In the human nervous system, sensory inputs are coded in a sparse manner where only small numbers of neurons are active at a given time, thus the sparse coding is reasonable to be as a plausible model of the auditory cortex. In this paper, we propose a biologically inspired feature extraction method for speaker verification based on sparse coding. When encoding the speech data using sparse codi...
متن کاملOPTIMALITY IN BIOLOGICAL SYSTEMS 6.03.2 DEFINING SPARSE CODING 6.03.3 PHYSIOLOGICAL EVIDENCE FOR SPARSE CODING 6.03.4 TWO VIEWS OF SPARSE CODING 6.03.4.1 Maximizing Information Transfer 6.03.4.2 Metabolic Constraints
Sparse coding has been proposed as a guiding principle in neural representations of sensory input, particularly in the visual system. Because sparse codes are defined as representations with low activity ratios—i.e., at any given time a small proportion of neurons are active—they are sometimes proposed as a means to help conserve metabolic costs. Although we accept that such metabolic costs pla...
متن کاملSparse Coding in the Neocortex
Sparse coding has been proposed as a guiding principle in neural representations of sensory input, particularly in the visual system. Because sparse codes are defined as representations with low activity ratios—i.e., at any given time a small proportion of neurons are active—they are sometimes proposed as a means to help conserve metabolic costs. Although we accept that such metabolic costs pla...
متن کاملDesign principles of the sparse coding network and the role of “sister cells” in the olfactory system of Drosophila
Sensory systems face the challenge to represent sensory inputs in a way to allow easy readout of sensory information by higher brain areas. In the olfactory system of the fly drosopohila melanogaster, projection neurons (PNs) of the antennal lobe (AL) convert a dense activation of glomeruli into a sparse, high-dimensional firing pattern of Kenyon cells (KCs) in the mushroom body (MB). Here we i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Current opinion in neurobiology
دوره 14 4 شماره
صفحات -
تاریخ انتشار 2004